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ABSTRACT 



To provide data for examining the variables that 
distinguish effective writers from ineffective ones, 1821 mid-west 
lOth-grade students wrote three themes at 3-week intervals. From a 
first reading of these papers, the sets of three themes from 432 
pupils, which were judged strong or weak in effective writing, were 
submitted to four judges for further evaluation. Students in the 
final groups of 124 effective and 127 ineffective writers were asked 
to fill out questionnaires of 68 items on their family and personal 
lives. Scholastic aptitude and academic status were also taken into 
account. Results indicated that (1) effective writers had parents 
with more formal education and lived in homes of higher socioeconomic 
status that ineffective writers; (2) effective writers were more 
likely to be female, younger, college-oriented, widely-read, and 
willing to write about their personalities and self-concepts than 
were ineffective writers; (3) effective writers engaged in music 
activities and favored academic courses while ineffective writers 
preferred vocational courses and liked English class least of all; 

(4) effective writers owned more books, wrote more for personal 
pleasure, and disliked grammar study more than ineffective writers; 

(5) writing effectiveness correlated with scholastic aptitude and 
academic status. (LH) 
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WHILE THE teaching of composition is assumed 
to be both good and necessary for the English class- 
room, little research has been done to aid the Eng- 
lish teacher in determining what is the best sequence 
of composition principles, what is the best method 
for what kinds of papers, or what is the best evalu- 
ation technique for what kinds of teachers. Many 
reasons may contribute to the lack of knowledge 
about composition, but one reason may be that little 
attention has been paid to the factors which make up 
the effective or the ineffective writer. True, there 
are the pedagogical cliches about the effective writ- 
er - that the student is more likely to be a girl, that 
she is brighter than the average, that she comes 
from a favored home, that she reads more widely 
and more often than the average, and that she is col- 
lege-oriented. But few investigations ha ve made 
any effort to search for many of the variables that 
separate the effective from the ineffective writer. 
Research recently completed by the author may sug- 
gest some variables for present consideration and 
future research. 



RELATED RESEARCH 



Although the reader can find numerous articles 
on composition, little will be found which suggests 
or establishes such variables. Stalnaker (5: 535) 
using the 1940 English Examination of the College 
Board Tests found that girls performed at a level 
superior to boys. Davidson and Balducci (1: 4 8 0) 
matched 40 subjects for age, intelligence, and per- 
sonality adjustment and used three Rorschach tests 
to determine verbal facility. They found no signifi- 
cant differences for sex or economic level, though 
. the authors noted that tests, while not statistically 
significant, did suggest that boys were superior to 
girls and the upper economic level superior to the 
lower. The most thorough study of such variables 
was made by Schonell (4) although the study w a s 







largely restricted to school subjects. Thus, the 
only variables that have been investigated are sex, 
socio-economic status, Intelligence, grades in Eng- 
lish and other School courses, reading, and various 
English skills. No really general investigation has 
been made. 

METHODOLOGY 

The procedure of the investigation followed these 
steps. 

Permission to use high school students was first 
obtained from administrators of two lar gc public 
high schools and one large parochial high school in 
a mkhvestern city (approximate population, 100,000). 
English teachers in these three schools were sur- 
veyed, and, with two exceptions, agreed to partici- 
pate in the experiment. 

The author, in consultation with authorities in the 
teaching of English on both college and secondary 
levels, decided to use one grade to reduce the prob- 
lem of the age variable. The tenth grade was cho- 
sen, for ibis grade seemed more likely to be typical 
of the native condition of adolescent writing effec- 
tiveness or ineffectiveness, being yet less influenced 
by high school English instruction. 

At the beginning of the experiment, 1937 tenth 
graders were available; of these 116 were excused 
from further participation because they did not write 
all the papers or because they dropped from school. 
The final population for the study was 1821 tenth 
grade students. 

A sampling procedure for the population was de- 
termined. Three methods were possible. 1. Using 
random numbers, approximately 400 students could 
have been selected, their themes could have then 
been submitted to judges, and, after ratings, the 
judges could have established a top group (effective) 
and bottom group (ineffective). Unfortunately, 
a large number of papers would have fallen into the 
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middle group, thus reducing the size of either ex- 
treme group and making data analysis suspect be- 
cause of the small number involved. Hence, this 
approach was abandoned. 2. Using all 1821 writers, 
three themes from each, judges could have been 
asked to rate each of the 1821 times three themes 
(5463 papers) and a top and bottom group established. 
But the rating of 5463 papers seemed a hum an im- 
possibility, and thus this plan was dropped. 3. Us- 
ing one reader (the author) to eliminate a sizable 
portion of the papers not likely to be placed at either 
end of the writing continuum, judges could be asked 
to rate papers of something better than 400 students. 
Although subjectivity was obvious in the final sam- 
ple. this judgmental sampling technique was chosen 
since it would leave the greatest number of students 
at the ends of the writing continuum for the judges’ 
ratings. No claim can be made that the sampling 
device chosen is the best technique, only that it was 
the most feasible for this experiment. 

Having determined the sampling procedure, the 
author then asked the teachers of the 182 1 tenth 
grade students to give class time for three themes, 
at approximately three week intervals. Diederich’s . 
(2: 585-592) eight rules for writing experiments 
were adhered to in this investigation: that at least 
two essays on different topics were needed if a re- 
liable means of writing skills was to be found; that 
topics be within the student’s comprehension; that 
all students write on the same topics; that all pa- 
pers be written in class; that sufficient time be al- 
lowed for writing, revising, and r ew r it in g ; that 
time for writing must not be cluttered with other 
matters; that papers be marked in accordance with 
criteria evolved beforehand; and that all papers be 
marked by at least two readers. 

A set of rules was given to teachers involved ask- 
ing that themes be written in class, that topics re- 
main unaltered (except for brief explanations to slow 
classes), that dictionaries be a 1 lo w e d , and that 
teachers were to leave the papers unmarked. 

The three theme topics were of different natures. 
The first v^as narrative, the students being asked to 
use the following sentences as a springboard: 
“When I remember what happened, lean laugh now. 
But it wasn’t funny then. ” The second was exposi- 
tory, the students being asked to assume that it was 
late in August, a visiting friend was ready to leave 
for home, and one day remained to cap the visit; the 
problem was to make a choice of several activities 
(students were allowed to choose one of their own if 
they wished) and then explain and defend that choice. 
The third theme, by far the most difficult, forced 
students to apply critical reasoning to a mimeo- 
graphed letter from a President of a large midwest- 
ern chainstore to his employees lamenting the re- 
cent disastrous strike and urging his employees not 
to be so foolhardy again. Students were asked to 
react to the letter (certain specific questions were 



given and suggestions made on further possible ideas 
they might entertain) and then write an argumenta- 
tive paper. 

Each of the 1821 first themes was then read twice 
and rated twice by the author, for content, organiza- 
tion, style, diction, mechanics, all the frteots which 
make writing an entity. Rating was done by placing 
themes in one of three piles, relatively effective, 
relatively average, or relatively ineffective. The 
same procedure was followed for themes two and 
three. All themes in all piles were then reread. 
Mean ratings of all three themes were calculated, 
and only those students with two of the three themes 
in one or the other of the writing extremes were re- 
tained for final reading and rating by the judges. 
While no alien) pi was made to keep the size of the 
top or bottom groups equal, there were 214 students 
with at least two of the three themes in the relative- 
ly effective pile, and 218 students with two of the 
three themes in the relatively ineffective pile. No 
attempt was made to maintain an equal number of 
boys or girls in either group. The reader will like- 
ly not be surprised that more girls than boys were 
in the effective group, more boys than girls in the 
ineffective group. Consequently, the reader is 
warned that there is a sex bias in the final analysis. 

Four judges, qualified by experience and reputa- 
tion in teaching high school composition, agreed to 
rate the 432 sets of three themes. After agreeing 
on standards of writing they would expect of effective 
communication, the judges were given the papers. 
Writers were assigned random numbers to minimize 
the possibility of giving one judge consecutive 
themes from one or the other extreme of written 
performance. Each set of 432 themes was divided 
into four packets. Each judge was asked to rate 
themes on a one to nine point scale in the following 
manner. The judge was to read each theme twice 
and then assign it to one of three piles, effective, 
average, or ineffective. After the completion of a 
packet, the judge was then to reread the effective 
pile once more and place each of the papers in three 
new piles, highly effective, effective, and somewhat 
less effective. Similarly, the average and the rela- 
tively ineffective papers were to be reread and re- 
piled. The final rating of the themes then would 
produce a one to nine point scale. A rating sheet 
accompanied each packet and judges were asked to 
write the point value opposite the number of the 
theme and not to write on any paper. 

Each judge having completed one packet of Theme 
I was then assigned a different packet of Theme I; 
hence, each student was rated twice for Theme I. 
Packets of Theme n and HI followed the same pro- 
cedure. Rotation of the packets assured the reading 
of each writer’s work by every rater, six ratings in 
all for the three themes. Pearson product moment 
correlation coefficients were calculated for the rat- 
ings. In Table 1, the capital letters indicate the. 
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TABLE 1 

CORRELATIONS AMONG JUDGES IN THEME 
RATING 



Thom o I Thomo II Thome III 



AD 1 

.93 


BA 2 
. 86 


AC 3 
. 75 


BD 4 
. 65 


AC 4 

.86 


I 

S s 
1 ' 


CB 3 
. 78 


DC 4 
. 86 


CB 1 
. 88 


DA 2 
. 85 


CD 2 

.83 


OB 3 

.82 



judges, the superscript numbers the number of the 
packet for the themes. Using the z-transformalion 
suggested by Guilford (3: 355-356, 616) mean cor- 
relations for each set of correlations was deter- 
mined - Theme I . 87, Theme II . 80, and Theme III 
. 84. The mean correlation for all correlations was 
. 84. Only one of these correlations, the rating cor- 
relation for readers B and D for Theme If, packet 
four, was less than the . 67 suggested by Diederich 
(2: 589) as the lower limit of acceptability. Hence, 
some faith may be placed in the ability of the four 
experienced teachers to agree on what is effective 
writing and to rate papers according to that agree- 
i ment. 

j From the table above, it is apparent that Theme 
II had the least agreement among readers. Hence, 
the author decided to use a random sample of papers 
, from Theme II as a test of reader reliability in re- 
j reading. Seventy-five paperswere returned to three 
j of the judges (Judge D was no longer in the country) 
approximately ten weeks after the first r eading. 

' The correlation of rereading suggests a high degree 
of rereading reliability: Judge A (packet three of 
! Theme II) . 71; Judge B (packet four of Theme II) . 72; 
and Judge C (packet 1 of Theme II) . 76. 

After the ratings had been determined, a mean 
j rating of all six ratings was calculated foreaclnvrit- 
er. The final group of ineffective writers, 127 stu- 
dents, was determined by choosing those w rile r s 
■ who had a mean rating of 3. 0 or less (3., 0 down rep- 
, resenting degrees of ineffectiveness). Using the 
same principle, that of assigning to the eff ec tive 
group those students with rating of 7. 0 to 9. 0 pr o- 
! duced only 90 writers. This group was supplement- 
1 cd with those writers who had at least four of the 
\ six ratings of 7. 0 to 9. 0, thus resulting in a f i nal 
! effective group of 124, The need to supplement 
the effective group may suggest what teachers of 
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English know from experience, that it is easier to 
agree on what constitutes poor writing than good 
writing. 

Data were obtained for the two groups of 124 ef- 
fective writers and 127 ineffective writers. Each 
student was given a lengthy questionnaire of GO Items 
r( luting to bte^uu^of 1) fathci'r’TTjob, education, 
reading, and froo-time activities, 2) mother’s Job, 
education, reading, and free-time a c t i v i t i e s, 3) 
home environmental factors of home ownership, 
languages spoken in the home, number and kind of 
books in the home, magazines subscribed to, TV 
watched, and family recreation, 4) personal data, 
right or left handedness, dating, part-time jobs, 
hobbies, free-time activities, college and vocation- 
al plans, 5) interest in school activities and classes, 
classes liked and disliked, languages studied, grade 
retention or advancement, and 6) English class ac- 
tivities liked and disliked, books owned and read, 
parts of newspapers read, topics liked and disliked 
in composition, and attitudes toward English. While 
questionnaires are open to attack - ambiguity of an- 
swers, lack of honesty - the q u e s t i o n n a i re still 
helps to uncover information otherwise most diffi- 
cult to find. Additionally, students were encouraged 
to write as much or as little as they wished, were 
guaranteed an interested and impartial reader, and 
were assured that no information would get back to 
teachers (questionnaires were sealed and returned 
to the author). The number of lengthy answers at- 
tacking English teaching and school in general at 
least suggests that many students gave honest re- 
plies. 

The Iowa Tests of Educatio n Development scores 
were used, notably the scores for Test 3 (Correct- 
ness of Appropriateness of Expression), Test 7 
(Ability to Interpret Literary Materials), Test 8 
(General Vocabulary) and Test 9 (Use of Sources of 
Information). 

Th e Otis Self- Administering Test of Mental Abil- 
it y, Higher Exam i nation is given to all ninth grade 
pupils in the schools involved and the score from 
this test was used. 

The academic records of the students were con- 
sulted and three averages were calculated: 1) a 
grade point average for seventh and eighth grade 
English courses; 2) a grade point average for ninth 
and first semester tenth grade English courses; and 
3) a general grade point average for ninth and first 
semester courses. Grade points were calculated 
with A being equal to 4. 0. 

The function of the analysis of all data was to dis- 
cover what variables differentiated between the di- 
chotomous group of effective and ineffective writers. 
The statistical tools most appropriate were 1) the 
chi square statistic, used to test the null hypotheses 
that the observed frequencies for the various ques- 
tionnaire responses did not depart significantly from 
the theoretical frequencies expected had there been 
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no relationship between response and writing ability; 
' ■ 2) the phi coefficient developed from 2x2 chi square 
tables as an index of correlation; 3) the C coefficient 
: developed from chi square tables larger than 2x2 

as an index of correlation; and 4) the point biserial 
correlation statistic for genuinely die ho tom o us 
!■ groups, with the F’-test for significance. Arbitrar- 
; ily, the level for significance for testing all slatis- 
i ' tics was determined as . 01. 

; DESCRIPTION OF THE DATA 

■ The treatment given to the data led to five analy- 

ses: the relation of the dichotomous criterion to se- 
lected measures of 1) parents, home, and family, 
2) student personal data, 3) school activities and 
classes, 4) English class activities and attitudes, 
t. and a) scholastic aptitudes and academic status. No 
attempt will be made to list all those factors which 
proved to be non-discriminating, only those few 
; which seemed significant in that they were at odds 
with the usual English teacher assumption. 

1. Parents, Home, and Family . 

Variables which proved to be discriminating at 
the . 01 level of significance were the father’s edu- 
cation (C = . 38), father’s pr e s e n t occupation 
(C - .38), father’s reading (C = . 28), mother’s ed- 
ucation (C = .30), mother’s reading of a foreign lang- 
uage (4? = . 27), number of magazines in the home 
(C = . 38), and the kind of phonograph records in the 
; home (C = . 26). Though no causality can be deter-- 

? mined from the use of x 2 of correlation without ref- 

erence to the materials from which the data were 
drawn, certain qualified inferences might be made. 
Apparently, parental education was significant, the 
greater amount of formal education being found in 
parents of effective writers. Similarly, the socio- 
economic status (father’s occupation, magazines 
read, kinds of records found) of the effective group 
l would appear to be higher. 

2. Student Personal Data 

j Discriminating variables proved to be sex (4> = 

: 53), age (C = . 30), grade retention (<f» = -. 28), en- 

[, joyment of working with hand tools ($ = -. 23), and 

j- college plans ('&=. 54). Guarded inferences f r o m 
[ these data might be that girls appeared more likely 
(in high school at least) to be effective writers, that 
j age was afactor in that ineffective w r i t e r s were 

: more likely to have been retained a grade, and that 

interest and plan3 in vocations was afactor, effec- 
tive writers being more likely to be interested in col- 
E lege centered vocations. Though not am e n abl e to 
statistics, answers to certain open-ended questions 
suggested that effective writers read more w idely 



and more frequently, and that effective writers were 
willing and able to write more about their personal- 
ities and had more flattering self-concepts (the ef- 
fective writers listed more personality virtues and 
the ineffective writers, more ambiguous responses). 

3. Sch ool A ctivities and Class os . 

Significant variables were activities enjoyed in 
participation (C = .34), activities enjoyed watching 
(C = .29), typewriters owned and used in classwork 
(4> ~ .29), favorite classes (C = .45), least liked 
classes (C - . 38), and foreign languages studied 
(C - .57). The data suggested that the effective 
group enjoyed participating more in musical activi- 
ties (probably the sex bias already mentioned) while 
the ineffective group often listed none of the choices, 
perhaps indicating that they felt themselves to be out- 
side of school in general. The effective group in 
listing its favorite classes chose more academically 
oriented classes, the ineffective group, vocational 
classes. Perhaps most significant was that English 
was the least liked class by the ineffective writers. 

4. English Class Activities and Attitudes 

Variables which proved discriminating were 
books owned by students (C = .23), attitude toward 
writing in class (C = . 25), writing published by stu- 
dents (4? = . 31), frequency of nonassigned writing 
(C = . 29), letter writing habits (C = . 34), and Eng- 
lish class activities least preferred (C = . 27). Again, 
the sex bias would enter, girls presumably m o re 
likely to write letters or compose for enjoyment. 
The data suggested that effective writers owned 
more books, and that effective writers were more 
likely to write for personal pleasure. Strangely 
enough, one significant variable was the activity 
least preferred in English, the effective group feel- 
ing less fondness for the study of grammar or me- 
chanics than the ineffective group. Two non- signif- 
icant variables of interest were the lack of signif- 
icance of the amount of reading done and lack of sig- 
nificance of the activities preferred in English class 
among reading, writing, speech, and grammar. 

5. Scholastic Aptitudes and Academic Status. 

As might be guessed by the reader, measures of 
intelligence aptitudes and academic status proved 
significant, the Otis IQ (r pbi = . 68); ITED Test 3 
“Correctness” (r pbi = . 79); ITED Test 7 “Literary 
Materials” ( rpbi = . 78); ITED Test 8 “Vocabulary” 
( r pbi = • 71); ITED Test 9 “Sources of Information” 
( r pbi = • 78); GPA for seventh and eighth grade Eng" 
lish (r pb i * . 82); GPA for ninth and tenth grade Eng" 
lish (r pb i = , 77); and GPA for all classes ninth and 
tenth grade (r pb i = . 78). 
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CONCLUSIONS 

Since this experiment was conducted in only one 
area of the midwest with a limited sample and with 
a degree of subjectivity early introduced, the con- 
clusions can only be tentative. Still certain repeti- 
tions of data suggested that the effective writer was 
likely to be female, brighter than average, living in 
a favored home, a reader, and fond of English class 
and school in general. Further research is needed, 
especially that which keeps the factors of sex, intel- 
ligence, and socio-economic status constant. Final- 
ly, such research would do well to delve i n to the 
psychological make-up and personality of the partic- 
ipants. Clearly, if we are to know what we can give 
our students to make them better writers, we must 
know what factors make up the effective or the inef- 
fective writer. 
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